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Nack Suppression for Multicast Protocols in 
Mostly One-Way Networks 



BACKGROUND OF THE INVENTION 
5 1 . Field of the Invention . 

This invention relates to multicast transmission of 
information across a data network. More particularly this 
invention relates to a technique for suppressing requests 
for retransmission of missing information by recipients 
10 at a downstream link of a mostly one-way data network. 
2. Description of the Related Art. 

The push model for distributing data over the Inter- 
net and other client server networks has become more 
widespread in recent years. In modern versions of this 
15 model a server "multicasts" data to an interested subset 
of clients on the network f known as a "multicast group''. 
Whoever is interested becomes a listener by joining the 
group* 

By their nature, push applications are closer to the 
20 broadcasting paradigm of radio and television than to the 
interactive paradigm of the World Wide Web. As such, 
broadband networks,, such as cable TV or satellite, can be 
used as a very efficient medium for the transmission of 
"pushed data". Unfortunately, currently these networks 
25 are one-way only. That is to say, data such as a televi- 
sion program is sent from a broadcasting facility (the 
head-end) to several receivers (end-users) without any 
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feedback. As such, these networks are inappropriate for 
popular interactive push applications since the latter 
require a return channel. Although attempts to upgrade 
the current public network infrastructure are underway in 
several places around the world, it will take some years 
until reliable two-way broadband networks are commonplace 
and therefore, a mechanism for multicasting over one-way 
broadband networks is desirable. 

In conventional unicast transmission, there are well 
known handshaking protocols that insure that blocks of 
data have been correctly received by the downstream re- 
cipient. The sender is easily able to determine whether a 
block of data requires retransmission, and can maintain 
awareness of the state of the recipient with little com- 
putational overhead. Without modifications, the unicast- 
ing techniques become unwieldy when applied to multicast 
transmission. Large numbers of recipients asynchronously 
requesting retransmissions are likely to produce conges- 
tion of the data network and degrade its performance. 
Furthermore, in the case of hierarchical multicasting ar- 
rangements, the algorithms based on estimating the paths 
to the recipient do not generalize well to tree struc- 
tures, and the model of the communication as a conversa- 
tion between sender and recipient does not stand up well. 

Various techniques have been attempted to minimize 
requests for retransmission, such as the formation of to- 
ken rings, and the use of a central controller. However 
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these techniques have had limited success due to problems 
of scalability, and the need to secure group-wide agree- 
ment. The latter approach is difficult in the case of 
groups having transient membership. 
5 In the document, A Reliable Multicast Framework for 

Light-weight Sessions and Application Level • Framing, 
Sally Floyd et al., SIGCOMM '95, Cambridge MA (1 
Sept. 1995), it is proposed to employ a model known as 
Application Level Framing. This is a decentralized ap- 

10 proach, in which all traffic is multicast. Each session 
has a bandwidth limit, below which group members send 
multicast reports advising of their current state. Re- 
ceivers learn of missing data either by examination of 
their received sequences, or by evaluation of a multicast 

15 report from another group member. Repair requests are 
multicast among the group. When a node is in receipt of a 
request or reply concerning a data element which it 
lacks, it suppresses its own request for repair. After 
receiving content from the server 10, the receivers 12, 

20 14, 16 may transmit acknowledgements or negative acknow- 
ledgements reflecting their current state. The reports 
are limited such that they do not exceed more than a pre- 
determined percentage 'of the network's bandwidth, in or- 
der to prevent network congestion. Nevertheless, there is 

25 necessarily some degradation of network performance 

The document, Reliable Multicast Transport Protocol , 
Shioshita, Teruji et al., Draft Document for the 37 th 
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IETF, Feb. 7, 1997, proposes a transport control mecha- 
nism to enable reliable multicast data transfer to a 
large number of receivers on a TCP/IP network from a 
server in parallel. This protocol promotes short delivery 
5 time, as the data is transferred only once, and conserves 
bandwidth because only one copy of the data is sent to 
the server. It has the advantage of requiring only a sin- 
gle session regardless of the number of receivers. How- 
ever, despite some optimizations, there remains a re- 

10 quirement for receiver confirmation by ACK/NAK responses 
and the retransmission of data to selected receivers 
based on the information associated with the NAK response 
are disadvantages, as large numbers of receivers issuing 
ACK/NAK responses can still cause network congestion. 

15 Another known multicast transport protocol is pro- 

posed in Starburst Multicast File Transfer Protocol 
(MFTP) Specification. Miller, K. et al. r Internet Draft, 
April 1998. This protocol operates in the Application 
Layer. 

20 In copending U.S. Application No. 09/138, 994, filed 

Aug. 24, 1998, of common assignee herewith, and hereby 
incorporated by reference, a technique of IP multicasting 
over existing broadbarid networks without using a return 
link is disclosed. This technique allows the issues of 

25 multicast group membership and error detection and recov- 
ery to be handled locally within an end-user terminal, 
without need for returning data to a host. According to 
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the technique a single data transmitter sends a group of 
data items to a subset of possible receivers over a 
one-way channel. Each data item is divided into blocks 
which are encapsulated to form datagrams, each including 
5 a block sequence number, a data item identifier, and a 
timestamp indicating the age of the data item.. A group 
directory is regularly sent by the transmitter to each of 
the possible receivers. The group directory contains in- 
formation for all groups of data items, enabling each re- 

10 ceiver to select the group of data item it wishes to re- 
ceive. Reliability is provided by periodic retransmission 
of missing data. Despite these advantages, significant 
problems remain. 
SUMMARY OF THE INVENTION 

15 It is a primary advantage of some aspects of the pre- 

sent invention that missing elements in a multicast 
transmission can be supplied while processing a minimum 
number of repair requests from clients* 

It is another advantage of some aspects of the inven- 

20 tion that network congestion is minimized during multi- 
casting. 

It is yet another advantage of some aspects of the 
invention that network* traffic is optimized during multi- 
cast transmission . 
25 These and other advantages of the present invention 

are attained by a multicasting system suitable for use in 
data network caches, software distribution arrangements, 
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and content provider applications in general. Content is 
multicast from a sender to a plurality of receivers over 
a data network, such as the Internet. Each receiver inde- 
pendently determines whether it is missing elements or 
5 packets of the content. Receivers having missing content 
each initiate a random timer. The receiver having the 
shortest random interval unicasts a negative acknowledge- 
ment to the sender* The sender immediately multicasts the 
negative acknowledgement to the other receivers. All 

10 other receivers having the same missing packet thereupon 
suppress their own negative acknowledgements as to that 
packet. A repair transmission is then multicast by the 
sender to all receivers. In some embodiments, the repair 
transmission could be multicast by a receiver possessing 

15 the missing packet. The random intervals have upper and 
lower bounds according to the round trip transmission 
time and the size of the largest missing data element. 

The invention provides a method of transmitting data 
over a communications network, which includes multicast- 

20 ing content in a first multicast over a data network from 
a sender to a multicast group. The group comprises a plu- 
rality of receivers. Concurrently, in each of the receiv- 
ers the method includes detecting a missing portion of 
the content, and delaying for a random interval. Thereaf- 

25 ter no more than one negative acknowledgement is sent in 
a second transmission from one of the receivers to the 
sender. Thereafter, responsive to the negative acknow- 
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ledgement the missing portion is multicast in a third 
multicast from the sender to the multicast group. 

According to an additional aspect of the invention, 
the random interval has a lower limit given by 
5 LL = (ait^x b 

wherein x is a multiplication operator, ai is a propor- 
tionality constant, tnan is the minimal round trip trans- 
mission time between the sender and a respective one of 
the receivers, and b is a size of a largest packet of the 
10 missing portion. 

According to an aspect of the invention, the random 
interval has an upper limit given by 

UL = (aitndn) X b 

wherein x is a multiplication operator, a 2 is a propor- 
15 tionality constant, t max is the maximum round trip trans- 
mission time between the sender and a respective one of 
the receivers, and b is a size of a largest packet of the 
missing portion. 

Another aspect of the invention includes determining 
20 a current quantity of traffic on the data network, 
wherein the second multicast is sent when the current 
quantity is less than a predetermined value. 

According to a futther aspect of the invention, the 
random interval is the shortest random interval of the 
25 receivers. 

According to yet another aspect of the invention, the 
third multicast is sent by the sender. 
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According to still another aspect of the invention, 
the third multicast is sent by one of the receivers. 

The invention provides a computer software product, 
comprising a computer-readable medium in which computer 
program instructions are stored, which instructions, when 
read by a computer, cause the computer to execute a 
method of transmitting data over a data network. The 
method includes multicasting content in a first multicast 
over the data network from a sender to a multicast group 
comprising a plurality of receivers. Concurrently, in 
each of the receivers the method includes detecting a 
missing portion of the content, and delaying for a random 
interval. Thereafter no more than one negative acknow- 
ledgement is transmitted to the sender. Thereafter, re- 
sponsive to the negative acknowledgement, the sender re- 
peats the negative acknowledgement to the receivers, oth- 
ers of which thereupon suppress their own negative ac- 
knowledgements. The missing portion is then multicast in 
a third multicast from either the sender or another of 
the receivers to the multicast group. 

The invention provides a computer system, which in- 
cludes a first computer, and a second computer intercon- 
nected in a data network with the first computer. The 
first computer and the second computer receive multicast 
content in a first multicast via the data network from a 
content server. The first computer and the second com- 
puter have program instructions stored therein, which in- 
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structions cause the first computer and the second com- 
puter to concurrently execute a method of transmitting 
data over the data network. The method includes detecting 
a missing portion of the content, determining random in- 
5 tervals, wherein the random interval of the first com- 
puter is shorter than the random interval of the second 
computer. The first and second computer delay for their 
respective random intervals. Thereafter the first com- 
puter sends a first negative acknowledgement to the con- 

10 tent server. In the event that the second computer has 
not received the missing portion, the second computer 
suppresses a second negative acknowledgement therefor* 
The missing portion is contained in a third multicast 
from the content server. 

15 According to an aspect of the invention, the third 

multicast is sent by the second computer. 
BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of these and other objects 
of the present invention, reference is made to the de- 

20 tailed description of the invention, by way of example, 
which is to be read in conjunction with the following 
drawings, wherein: 

Fig. 1 is a schematic illustrating the interconnec- 
tion of a computer system in a data network for use ac- 

25 cording to the present invention; and 

Fig. 2 is a flow chart of a method of transmitting 
data according to the invention. 
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DESCRIPTION OF THE PREFERRED EMBODIMENT 

In the following description, numerous specific de- 
tails are set forth in order to provide a thorough under- 
standing of the present invention. It will be apparent 
5 however, to one skilled in the art that the present in- 
vention may be practiced without these specific- details. 
In other instances well known circuits, control logic, 
and the details of computer program instructions for con- 
ventional algorithms and processes have not been shown in 
10 detail in order not to unnecessarily obscure the present 
invention. 

Software programming code, which embodies the present 
invention, is typically stored in permanent storage of 
some type, such as a computer readable medium. In a cli- 

15 ent/server environment, such software programming code 
may be stored on the client or a server. The software 
programming code may be embodied on any of a variety of 
known media for use with a data processing system, such 
as a diskette, or hard drive, or CD-ROM v The code may be 

20 distributed on such media, or may be distributed to users 
from the memory or storage of one computer system over a 
network of some type to other computer systems for use by 
users of such other s'ystems . The techniques and methods 
for embodying software program code on physical media 

25 and/or distributing software code via networks are well 
known and will not be further discussed herein. 
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Turning now to the drawings, and to Fig. 1 thereof, 
there is shown a high level architectural diagram of a 
preferred embodiment of a multicasting system 18 which 
employs the techniques of the present invention. The 
5 source of the content to be distributed is a server 10, 
which is provided with transmitting capability, * and also 
has receiving capability. In a hierarchical tree, the 
server 10 is a parent with respect to a plurality of 
downstream receivers 12, 14, 16. Content is multicast 

10 from the server 10 via a data network, which may be the 
Internet, to the receivers 12, 14, 16. The receivers 12, 
14, 16 are generally provided with transmitting capabil- 
ity also, and are interconnected with one another and 
with the server 10. The receivers 12, 14, 16 are linked 

15 respectively to random timing circuits 20, 22, 24, which 
trigger transmissions by the receivers 12, 14, 16 in a 
manner disclosed hereinbelow. 

The server 10 preferably employs the REMADE protocol 
to multicast the content. The REMADE protocol is dis- 

20 closed in the above noted U.S. Application No. 
09/138,994. The REMADE protocol is a technique of IP mul- 
ticasting over existing broadband networks without using 
a return link. This tebhnique allows the issues of multi- 
cast group membership and error detection and recovery to 

25 be handled locally within an end-user terminal, without 
need for returning data to a host. According to the tech- 
nique, a single data transmitter sends a group of data 
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items to a subset of possible receivers. Each data item 
is divided into blocks, which are encapsulated to form 
datagrams, each including a block sequence number, a data 
item identifier, and a timestamp indicating the age of 
5 the data item. A catalog, comprising a group directory is 
regularly sent by the transmitter to each of the- possible 
receivers. The group directory contains information for 
-J* all groups of data items, enabling each receiver to se- 

li lect the group of data item it wishes to receive. Reli- 

10 ability may be enhanced by periodic retransmission of 
missing data. 

In some embodiments, improvements in the REMADE pro- 
tocol which were disclosed in our copending Application 
11 No. 09/564,387, filed May 3, 2000, and herein incorpo- 

I:; 15 rated by reference, may be used in the practice of the 
present invention. 

The procedure for dealing with negative acknowledge- 
ments is now explained with reference to Fig. 1 and 
Fig. 2. In the configuration of the data network, the 
20 minimal and maximal round trip times between the 
server 10 and each of the receivers 12, 14, 16 is deter- 
mined by known techniques. The multicast transmission oc- 
curs in blocks or packets, which may vary in size, ac- 
cording to the particular transmission protocol employed, 
25 However, the size of the blocks or packets is also known 
to the receivers 12, 14, 16. 
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At initial step 26 the server 10 multicasts content, 
for example a group directory, in accordance with the 
REMADE protocol. After receiving content from the 
server 10 at step 28, the receivers 12, 14, 16 then 
5 evaluate the content to determine whether data is missing 
at decision step 30. 

If at decision step 30 it is determined that no data 
is missing, then no action is required, and control pro- 
ceeds to termination step 32. 

10 If at decision step 30 it is determined that data is 

missing, for example in the receiver 12, then at step 34 
the random timing circuit 20 is initiated. A delay occurs 
for a random interval, until a signal is received by the 
receiver 12 from the random timing circuit 20. The random 

15 interval has a lower limit given by 



wherein "x" is the multiplication operator. The factor ai 
is a proportionality constant. The value t^n is the mini- 
mal round trip transmission time between the server 10 

20 and the receiver 12. The value ai may be adjusted for a 
particular application, or in some embodiments can be 
varied according to prevailing conditions on the data 
network. The quantity 'b is the size of the largest miss- 
ing data element. 

25 The random interval has an upper bound given by 



LL = (aitxoirjx b 



(1) 



UL = (a 2 t max )x b 



(2) 
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wherein "x" is the multiplication operator. The factor a 2 
is a proportionality constant. The value t max is the maxi- 
mum round trip transmission time between the server 10 
and the receiver 12. The value a 2 may be adjusted for a 
5 particular application, or in some embodiments can be 
varied according to prevailing conditions on -the data 
network. The quantity b is the size of the largest miss- 
ing data element . 

When a signal is received from the random timing cir- 

10 cuit 20, the receiver 12 transmits a negative acknow- 
ledgement reflecting its current state at step 36 to the 
sender . In some embodiments, the transmission of step 36 
could be multicast to the other receivers as well. This 
transmission is inhibited, however, if it would cause 

15 . network traffic to exceed more than a predetermined per- 
centage of the network's bandwidth. This limitation is 
desirable in order to minimize network congestion . It is 
understood that decision steps 30 and step 34 are also 
occurring simultaneously in the receivers 14, 16, but 

20 that the random timing circuit 20 was the first of the 
random timing circuits 20, 22, 24 to trigger. 

When the receiver 12 transmits its current state, the 
report is received by f the server 10 at step 38. At step 
40, the server repeats the negative acknowledgement to 

25 the other receivers in a multicast report. At step 42 the 
report is received by the receivers 14 , 16, as indicated 
by the arrows in Fig. 1. 
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At decision step 44 the receivers 14, 16 independ- 
ently evaluate whether they are missing the same informa- 
tion as was reported missing by the receiver 12 in 
step 36. If the result of this test is affirmative, then, 
5 at step 46, any of the receivers 14, 16 missing the in- 
formation simply wait until a repeat transmission is sent 
by the server 10. As shown at step 45, they do not multi- 
cast or otherwise transmit their own negative acknow- 
ledgement as to the information which was reported as 

10 missing by the receiver 12. 

It the result of the test at decision step 44 is 
negative, then the receivers 14, 16 simply resume await- 
ing the random timing circuits 22, 24 to trigger, and 
control proceeds to termination step 32. 

15 In response to reception of the multicast of the re- 

ceiver 12 at step 38, and following completion of 
step 40, a repair transmission is multicast at step 48. 
The repair transmission is effected in some embodiments 
by the server 10. In other embodiments one of the receiv- 

20 ers 14, 16 may respond, according to a particular control 
policy. A control policy, for example, could require the 
first unit receiving the negative acknowledgement from 
the receiver 12 to produce a repair transmission if pos- 
sible . 

25 The repair transmission is detected by the receiv- 

ers 12, 14, 16. All further repair transmissions are then 
suppressed. Those receivers, which are missing the data 
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element contained in the repair transmission, accept it, 
and make appropriate internal corrections to their files 
at step 50. Control then proceeds to termination step 32. 
In the foregoing description it could be the case 
5 that all three of the receivers 12, 14, 16 were missing a 
particular data element. Yet, only one negative acknow- 
ledgement was placed on the data network . Up to two mes- 
sages were suppressed, with corresponding benefit to the 
load on the data network. 

10 It should be noted that while the system 18 is repre- 

sented for clarity in Fig. 1 as a two-level tree, com- 
prising the server 10 and the receivers 12, 14, 16, there 
can be any number of levels arranged in a more complex 
tree-structured hierarchy, as appropriate for a particu- 

15 lar application. In such case the receivers 12, 14, 16 
communicate with a lower level of receivers, which may be 
part of the same or a different multicast group. The im- 
provement in performance of the data network linking all 
the receivers is scalable, and the advantage of the dis- 

20 closed arrangement as compared with the conventional mul- 
ticasting systems becomes greater as the number of re- 
ceivers increases . 

While this invention has been explained with refer- 
ence to the structure disclosed herein, it is not con- 

25 fined to the details set forth, and this application is 
intended to cover any modifications and changes as may 
come within the scope of the following claims: 
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